Capacity of the Hopfield model

نویسندگان

  • Jianfeng Feng
  • Brunello Tirozzi
چکیده

For a given 0 < δ < 2 if [Nδ] neurons deviating from the memorized patterns are allowed, we constructively show that if and only if α(δ) := p(N)/N = (1 − 2δ)2/(1 − δ)2 all stored patterns are fixed points of the Hopfield model. If [NδN ] neurons are allowed with δN → 0 then αN = (1−2δN )2/(8−1(1−δN ))2 → 0 where 8 is the distribution function of the normal distribution. The result obtained by Amit and co-workers only formally coincides with the latter case which indicates that the replica trick approach to the capacity of the Hopfield model is only valid in the case αN → 0(N →∞).

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

محاسبه ظرفیت شبکه عصبی هاپفیلد و ارائه روش عملی افزایش حجم حافظه

The capacity of the Hopfield model has been considered as an imortant parameter in using this model. In this paper, the Hopfield neural network is modeled as a Shannon Channel and an upperbound to its capacity is found. For achieving maximum memory, we focus on the training algorithm of the network, and prove that the capacity of the network is bounded by the maximum number of the ortho...

متن کامل

Dynamic Capacity Estimation in Hopfield Networks

Understanding the memory capacity of neural networks remains a challenging problem in implementing artificial intelligence systems. In this paper, we address the notion of capacity with respect to Hopfield networks and propose a dynamic approach to monitoring a network’s capacity. We define our understanding of capacity as the maximum number of stored patterns which can be retrieved when probed...

متن کامل

Information capacity of the Hopfield model

The information capacity of general forms of memory is formalized. The number of bits of information that can be stored in the Hopfield model of associative memory is estimated. It is found that the asymptotic information capacity of a Hopfield network of N neurons is of the order N3 b. The number of arbitrary state vectors that can be made stable in a Hopfield network of N neurons is proved to...

متن کامل

On the Critical Capacity of the Hopfield Model

We estimate the critical capacity of the zero-temperature Hopfield model by using a novel and rigorous method. The probability of having a stable fixed point is one when α ≤ 0.113 for a large number of neurons. This result is an advance on all rigorous results in the literature and the relationship between the capacity α and retrieval errors obtained here for small α coincides with replica calc...

متن کامل

Storage Capacity of Kernel Associative Memories

This contribution discusses the thermodynamic phases and storage capacity of an extension of the Hopfield-Little model of associative memory via kernel functions. The analysis is presented for the case of polynomial and Gaussian kernels in a replica symmetry ansatz. As a general result we found for both kernels that the storage capacity increases considerably compared to the Hopfield-Little model.

متن کامل

The storage capacity of the Hopfield model and moderate deviation principles

This note relates the storage capacity of the Hopfield model of neural networks to the existence of a moderate deviation principle for the empirical correlation of the patterns. This moderate deviation principle is satisfied under a certain condition on the moment generating function of these correlations which on the other hand can be verified in many cases by GHSand FKG-type inequalities. Exa...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1997